ED 068 018 



DOCUMENT BESOHE 



CS 000 940 



AUTHOR 
TITLE 

PUB DATE 
NOTE 



Brunner, Joseph F. ; Grebe, Shelley F. 

An Evaluation of Graduate Students 1 Perceptions of 

Program Objectives, 

73 

17p.; Unpublished study conducted at the Beading 
Center of the State of Hew Jersey, Hontclair State 
College 



EDBS PBICE 
DESCRIPTORS 



MF-$0.75 BC-S1.50 

♦College Programs ; Educational Objectives; Higher 
Education ; ♦Masters Degrees ; *Ob jectives; Reading; 
♦Reading Programs; ♦Reading Research; Reading 
Skills 



ABSTRACT 

The purpose of this study was tc collect information 
about the graduate degree program in reading at Hontclair State 
College, the graduates 9 professional and educational involvement, and 
graduates 1 perception and assessment of the level of attainment of 
the program objectives. Questionnaires were sent to 42 master's 
graduates from the graduate degree program in reading who graduated 
from 1968 through 1973. The college *s catalog of courses was used to 
specify objectives of the graduate degree program in reading. Each 
catalog course description was studied to extrapolate objectives. A 
total of 28 course objectives reflecting this extrapolation procedure 
were constructed* A five-point rating scale was assigned to each 
item. Some of the results indicated that the differences between 
reading specialists* and classroom teachers* assessments of 
objectives reflecting required and elective courses and applied and 
theoretical information were not significant. Beth groups rated 
objectives reflecting applied information highest and objectives 
reflecting theoretical information lowest, and classroom teachers 
rated the objectives from three of four areas higher than reading 
specialists did. (HE) 
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INTRODUCTION 

Historically, follow-up studies of recipients of 
graduate degrees have concerned themselves with (a) seek- 
ing information pertaining to the nature and extent of the 
graduates* professional and education growth (DeSanctis, 
1971* Sater, 1959i Stone, 1973) and (b) providing a basis 
for assessing the extent to which program objectives werr 
achieved (Bettis, 1973* Milner, 1973, Skinner, 1972). An 
underlying purpose of these "studies was to provide an 
empirical basis for futher program modifications in the 
hope that such programs would attain their maximum effect- 
iveness. In addition, the information obtained could plro 
serve to support program objectives already operational. 
This present study was concerned wibh a follow-up of the 
Master's graduates from the Reading Program at Montclair 
State College, Upper Montclair, New Jersey. 

The Graduate Degree Program in Reading at Montclair 
State College was established in September, 1966. The 
Reading Program is one aspect of a total teacher education 
component at the College • One of its primary functions is 
to train classroom teachers who express an interest in 
becoming Reading teachers and/or reading specialists in 
the public schools. A total of thirty-three semester 
hours is required for the Master of Arts Degree. These 
credits are distributed in the following areas i (1) Depart- 
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mental Specialization, twelve to twenty-one semester hours i 
(2) Basic Professional Education, six to nine semester 
hours i (3) Free Electives, six to twelve semester hours. 

Purpose 

It was the purpose of this study to collect information 
about the Graduate Degree Program in Reading at Lontclair 
State College i the graduates* professional and educational 
involvement* and the graduates' perception and assessment 
of the level of attainment of the program objectives, F^r 
the purpose of this paper, only those findings pertaining 
to the graduates' perception and assessment of the level 
of attainment of the program objectives have been reported.* 

DESCRIPTION OP STUDY SAMPLE 

From 1968 through 1973 t there were fifty-four Map+t~*s 
graduates from the Graduate Degree Program in Reading it 
Montclair State College « Of that number , fifty -three are 
presently living. Known addresses were obtained for forty- 
two of the graduates. Questionnaires were sent to these 
graduates, and responses were received from twenty-eight, 
or 66. 6#. Of this total, twenty-five, or 59*5% were 
deemed usable for this study. 

For anlaysis of data* the population was stratified 



1. For the complete findings of this report, see 
Shelley F. Grobe, "A Follow-up Study of the Master's 
Graduates from the Reading Program at Montclair State 
College, M Master's project, Montclair State College, 
197** (unpublished ) , 
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into two major groups. Group I consisted of those grad- 
uates who were employed as reading specialists and repre- 
sented sixteen, or 64£ of the study sample. Group II con- 
sisted of those graduates who were employed as regular 
classroom teachers who did not teach reading and represented 
nine, or JS% of the study sample. 

METHODS AND PROCEDURES 

A mail questionnaire method was used to obtain infor- 
mation pertaining to the graduates' background and thei~ 
perceptions of the level of attainment of program obje ;tive3. 
The College^ catalog of Announcement of Courses was util- 
ized to specify objectives of the Graduate Degree Program 
in Reading. Each catalog course description was studied 
to extrapolate objectives. A total of twenty-eight course 
objectives reflecting this extrapolation procedure were 
constructed. A five-point rating scale similar to the 
Likert scale (Tuckman, 1972} was assigned to each item. 
For example, an "Almost Always" response was assigned a 
point value of 5i while a "Rarely 11 response was assigned 
a 1 point value. The questionnaire was then submitted to 
a Graduate Seminar in Reading for evaluations and suggest- 
ions* After two specific evaluation sessions, the quest- 
ionnaire was deemed ready for use. 

Means were computed from the five-point scale and 
were used to report comparative assessment (by Groups I 
and II) of objectives related to required and elective 
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courses and objectives reflecting applied and theoretical 

2 

information. In additon, percentages were used to report 
comparativa assessment of objectives related to specific 
courses. 

In order to ascertain possible significant relation- 
ships between the mean assessments by Group I and II, a 
corrected chi square formula was utilized.^ 

RESULTS 

Sompar8 t jve Assessment of Course Objectives 

The data in TABLES I and II show the comparative 
results obtained from mean' analyses of Group I and Grocp 
II f s perception of the level of attainment of four cate- 
gories of program objectives. Means were obtained by assign- 
ing point values to each category of response for each 
item (Almost Always, Generally, Prequentlyi Sometimes, and 
Rarely), Point values range from 5.0 (highest) to 1.0 
(lowest). 

1 The data in TABLE I show the comparative assessment 
of objectives related to required and elective courses. 



2. Applied information pertained to those aspects of . 
the the program objectives that were or could have been 
implemented within the scope and time of the program and/ 
or within the classroom setting. Theoretical information 
pertained to those aspects of the program objectives that 
emphasized understanding, concpets, and knowledge. 

3. For pupose of analysis the Yate's Correction for 
Continuity was used. This correction should be used when 
any of the expected frequencis is less than 5* See George 
H. Ferguson, Statistical Analysis in Psychology and Educ - 
ation , McGraw-H ill , 1966 . 

l . • 
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The mean rating of objectives from required courses by 
Group I was 3.7 with a range from 5»0 to 1.0, The mean 
rating by Group II of these same objectives was 4.1 with 
a range from 5.0 to 1.0. 

Group I*s mean rating of objectives from elective 
courses was 3.5 with a reported range of 5.0 to 1.0. Group 
II's mean rating of these objectives was 4.0 with a range 
from 5»0 to 2.0. 

TABLE I 



MB AN ANALYSES OF ASSESSEMENT OF OBJECTIVES 
FROM REQUIRED AND ELECTIVE COURSES 
BY GROUP I AND GROUP II 



Group 


Objectives Related to Objectives Related to 
Requ5~2d Courses Elective. Courses 


Group I 


3.7 3-5 


N=l6 




Group II 


fLtl iijo 


N=9 




Difference 





*Not significant at the .05 level 



The data in TABLE II show the comparative assessment 
of objectives reflecting applied and theoretical infor- 
mation. Group I's mean assessment of objectives reflect- 
ing applied information was 4.0 with a range from 5*0 to 
1.0. Group II*s mean assessment of these objectives was 
^e3 with a reported range of 5.0 to 1.0. 

Croup I's mean assessment of objectives reflecting 



9 
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theoretical information was 3.^5 with a range from 5.0 to 
1.0. Group II 9 s mean assessment of these objectives was 
3.9 with a range from 5*0 to 2.0. 

TABLE II 

MEAN ANALYSES OF ASSESSMENT OP OBJECTIVES 
REFLECTING APPLIED AND THEORETICAL 
INFORMATION BY GSOUP I AND GROUP II 



Group 


Objectives .Reflecting 
Applied Information 


Objectives Reflecting 
Theorectical Information 


Group I 


4.0 


3.*5 


N»l6 




Group II 










Difference 


.3* 


.45* 



♦Not significant a* the .05 level 



Comparative Assessment of Objectives Related to 
Specific Courses 

The data in TABLES III through VI show t by percentage 
of response to each category (Almost Always, Generally $ 
Frequently, Sometimes , and Rarely) per itfim, the compara- 
tive assessment of ^objectives from specific courses. 
Determination of high and low ratings was made by using 
the highest two response categories (Almost Always and 
Generally) and the lowest two response categories (Some- 
times and Rarely). 

The data in TABLE III represent the categorical 
assessment of objectives related to The Nature of Reading 
(a required introductory course in the program). The data. 
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reflect Group II f s "high" assessment of the objectives 
related to this course a? being higher than Group I's 
with respective percentages off 83.3 and 65.6. The percent 
age of "low" ratings by Group II was 5»6 as compared to 
Group I's which was 18.7« 

TABLE III 

PERCENTAGE OF RESPONSES TO STATEMENTS 
RELATED TO OBJECTIVES PROM 
THE NATURE OP READING* 



Group I 
N=16 


Category j 


Group ".I 


25.0 


Almost Alwavs 




*M>.6 


Generally 


— Jfefr 


15.6 


Sometimes 




3.1 


Rarely 





*The difference between the reported percentage *h7T" 
iQ0# total reflects the procedure used to compute "bigf 1 " 
and "low" assessments. 



The data in TABLE 1/ represent the categorical 
assessment of the objectives related to Case Studies of 
Reading Diff iculties . Group II f s *high* assessment of 
these objectives was 93«3# as compared to Group I's which 
was 83.7J6. The percentage of "low* ratings by Group II 
was 2*2% compared to Group I's 2»5%» 

The data in TABLE V represent the categorical assess- 
ment of objectives related to Corrective and Remedial 
Reading . Group II s s "high" assessment of these objectives 
was higher than that by Group I with respective percent- 
ages of 81.5 and ?5»0. The percentage of *low" assessment 
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by Group II was 0. as compared to Group i"g 16. 7« 

TABLE IV 

PERCENTAGE OP RESPONSES TO STATEMENTS 
RELATED TO OBJECTIVES PROM 
CASE STUDIES OF READING 
DIFFICULTIES* 



Group I 
N=l6 


Category 


Group II 
N=*9 


*7.5 


Almost Always 


60.0 




Generally 


33.3 




Sometimes 




1.25 


Rarely 





♦See footnote for TABLE III 



TABLE 1 

PERCENTAGE OF RESPONSES TO STATEMENTS ' 
RELATED TO OBJECTIVES FROM 

READING* 



Group I 
N«iS 


Category 


Group II 
N=9 


18. 75 


Almost Always 


55.6 


56.25 


Generally 


25. v 


12.5 


Sometimes 




4.2 


Rarely 





*See footnote for TABLE III 



The data in TABLE VI represent the categorical assess- 
ment of objectives related to Methods of Research and Research 
Seminar in Reading . Group I's "high" assessment of these 
objectives, ^7.9# was higher than Group II # s of 40.6#. 
The percentage of "low" assessment by Group I, however, 
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kO. 6 , was greater than Group II f s "low" assessment which 
was 25.0, 

TABLE VI 

PERCENTAGE OF RESPONSES TO STATEMENTS 
RELATED TO OBJECTIVES PROM 
METHODS OP RESEARCH AND 
RESEARCH SEMINAR IN 
READING* 



Group I 
N-16 


Category 


Group II 
N*9 


23 t 95 


Almost Always 


22.2 


2^.0 


Generally 


18.4 


30.2 


Sometimes 




^0.6 


Rarely 


11.1 



♦See footnote for TABLE III 



.SGMMAlU AwD LUSUUSSilON UJ? rJLWUlWliS 

Summary 

There was no significant difference between Group I 
(reading specialists) and Group II f s (classroom teachers) 
mean assessment of objectives related to required and 
elective courses and objectives reflecting applied and 
theoretical information. Despite the lack of statistical 
significance, Group II's assessment of the above prescribed 
group of objectives was higher than Group I*s> 

Group II rated a higher "high" assessment for object- 
ives related to three out of four specific courses i Nature 
of Reading i Casta Studies of Reading Difficulties ? and Cor - 
rective and Remedial Readings Group I had a greater "high" 
assessment for objectives related to Methods of Research 
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and Research Seminar in Reading. 

The Department's two clinical experience-related 
courses, Case Studies of Reading Difficulties and Correct- 
ive and Remedial Reading , received part icularjy favorable 
assessment from both Groups. 

Discussion 

The difference between Group I (reading specialists^ 
and Group II's (classroom teachers) assessment of objectives 
reflecting required and elective courses and applied ano 
theoretical information was found to be not significant 
at the .05 level. Group membership and perception of course 
objectives were found to be independent variables. In other 
words » both reading specialists and classroom teachers with 

Despite the lack of statistical significance, however, 
mean differences were reported between the two Groups. 
Group II (classroom teachers) rated all objectives in t!.e 
above categories higher than Group I f s ratings. The mean 
range of difference was from .3 to .5« The highest mean 
rating by both Groups was for objectives reflecting applied 
information, and the lowest mean rating by both Groups was 
for objectives reflecting theoretical information. (See 
TABLES I and II). 

The fact that there existed a lower rating of program 
objectives by reading specialists (Group I) may suggest, that 
there exists a discrepancy between formal course work and 
program experiences and the daily instructional problems 
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faced by a teacher in a school setting. For example, a 
teacher in training may find the clinical situation highly 
structured and somewhat idealized. Often there may be only 
one or two students to work with. In the actual classroom 
setting, this may not be the case, and a greater degree of 
adaptation and flexibility may be necessary. 

Both Groups rated objectives reflecting applied infor- 
mation highest and objectives reflecting theoretical infor- 
mation lowest. Objectives measuring applied information 
reflect learning experiences that could be implemented 
immediately in the program and/or in the classroom. Also, 
there .exists a greater potential for transferring this ap- 
plied knowledge as perceived by those graduates surveyed. 
The infozVucitio** aitu okiiif learned in xhis area can oe 
recognized and measured within a given time span. The 
results from the graduates suggest that the Reading Program 
was particularly strong in this area. 

Theoretical information, on the other hand, emphasizes 
understandings, concepts and knowledge on a less "concrete" 
level. In practice, it is more difficult to determine 
how thoroughly these learnings are achieved. In teaching 
Reading, there is. less opportunity for the instructor to 
ascertain whether a particular concept was thoroughly 
mastered and/or applied. The combined mean rating by 
both Groups for these objectives was 3-6?, and although 
considered a "high" assessment for determination of stat- 
istical significance, this group of objectives received 
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the lowest rating. Perhaps the reason for this was the 
graduates* inablility to assess their level of attainment 
of this body of knowledge, and perhaps the Program's teach- 
ing of theories related to Reading reflects a problem endemic 
to theoretical knowledge itself. 

Classroom teachers (Group II) rated the objectives 
from three of four areas higher than reading specialists 
(Group I) didi Nature of Reading! Case Studies of Reading 
Difficulties i and Corrective and Remedial Reading . The 
one area which received a higher assessment by reading 
specialists was Methods of Research and Research Seminar 
in Reading , 

Methods of Reasearch and Research Seminar in Reading 
arc re / lv^ Tva ' , ^^^o^ for all Master* s candidates. Grrwo 
I*s (reading specialists) higher "high" assessment of 
these objectives was probably due to this Groups* more ✓ 
active involvement in research related to Reading. As 
reading specialists, this Group is presumably more involved 
in journal reading and professional writing. 

Grotp I*s highest "high" assessment was for Case Studies 
of Reading Difficulties . Although this course did not 
not receive Group II*s (classroom teachers) highest "high" 
assessment* it came within l.ljt of this rating. This course 
is considered to be a particular strenth in the Program. 



*f. It is reported in the complete study that two 
graduates engaged in writing which led to publication. 
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Interestingly , Group I*s highest "low" assessment was 
for Methods of Research and Research Seminar in Reading . 
This was the one area that received a greater "high" assess- 
ment by Group I* The percentage of "low 11 assessment was 
almost equal to that for "high" assessment (.75£ less), 
This suggests that these two courses had particular value 
and/or interest for almost one half of the reading special- 
ists and little value for almost half of this same popu- 
lation. A reason for the intra-group disparity in agree- 
ment of assessment of these objectives may have been caused 
by one part of the Groups' active application of knowledge 
gained from these courses as compared to the other members 
of the Group who Kay not be applying this knowledge. It 
is significant to note that the two graduates who had 
articles published responded *Alaost Always" to the item 
pertaining to the level at which they felt they were able 
to execute independent researci. 

course that received neither highest "high" or 
highest "low" assessment but which received relatively 
favorable ratings by both Groups was Corrective and Remedial 
Reading . This Course, like Case Studies of Reading Diffi - 
culties , involves clinical experinces with children and 
was rated as a strength of the Reading Program. 

RECOMMENDATIONS AND CONCLUSIONS 

The recommendations and conclusions set forth in this 
paper are an outgrowth of the major findings of this study. 
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Although the program objectives received relatively high 
assessments by the graduates, there existed inter-group 
and (in one instance) intra-group differences in perceptions 
of the level of attainment of these objectives. It should 
be remembered that this study was based upon a population 
representing only approximately 60J5 of thosn graduates for 
whom addresses were obtained. 

The assessment of objectives related to the Program's 
two clinical experience courses » Case Studies of Read jug 
Difficulties and Corrective and Remedial Reading, by both 
Group I (reading specialists) and Group II (classroom teach- 
ers) were particularly favorable. It is concluded that 
these courses provided graduate students with positive 
program experiences and therefore should be continued ut 
their current operational level. 

The assessment of objectives related to the two 
research oriented courses, Methods of Ra search and Research 
Semina r in Reading , by Groups I and II were comparatively 
low. If class size was a variable in assessing these spe- 
cific courses* which these wrtiers believe is the case, it 
is recommended that class size in these courses be kept to 
a minimum (perhaps 15 students) in order to provide for a 
more intensive research pursuit. For example, current 
enrollment in these courses is approximately thirty students. 
It is further recommended that the graduate students 1 papers 
be directed toward a level acceptable for publication. 
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Although there was no statistical difference found 
between the two Group 1 perceptions of objectives related 
to various classifications of program objectives, Group II 
(classroom teachers) assessed most objectives at a higher 
level than Group I (reading specialists) did. It is rec- 
ommended that there be an additional follow-up study to 
ascertain whether or not there persists this discrepancy 
between reading specialists and classroom teachers* per- 
ceptions. 

Finally, it is recommend®! that the Reading Depart- 
ment supervise a periodic follow-up study of its graduates 
through the questionnaire method to obtain information 
similar in nature to that which this eLudy sought. 
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